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CONTROL SYSTEM FOR DEPOSITING 

POWDER TO A MOLTEN PUDDLE 

CROSS REFERENCE TO RELATED TO RELATED APPLICATIONS 

This application claims priority to 
5 Provisional Application Serial No. 60/163,548 filed 
November 4, 1999 and entitled ^^CONTROL SYSTEM FOR 
' DEPOSITING POWDER FOR LASER WELDING APPLICATIONS" . 

This application claims priority to 
Provisional Application Serial No. 60/163,643 filed 
10 November 4, 1999 and entitled /'^POSITION CONTROL 
SYSTEM FOR DEPOSITING POWDER FOR LASER WELDING 
APPLICATIONS" . 

The Government may have certain rights to 
this invention under a Cooperative Research and 
.15 Development Agreement (CRADA) 

BACKGROUND OF THE INVENTION 
The present invention relates to a control 
system for welding applications. In particular, the 
present invention relates to a control system for 
20 depositing powder iii a molten puddle . 

Welding applications use an energy source 
or laser to melt a molten puddle. For deposition 
welding, layers of a weld material or powder are 
deposited into the molten puddle to form three- 
25 dimensional objects. Powder is dispersed from a 
nozzle which is aimed to deposit the powder into the 
molten puddle. The molten puddle cools to solidify 
the fused powder to form the three-dimensional 
object. For optimum operation, it is desirable to 
3 0 accurately aim the powder dispersed from the nozzle 
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so that all of the powder is deposited to a desired 
location (s) in the molten puddle. Powder deposited 
outside the molten puddle or improperly can have 
certain deleterious effects on the metallurgical 
5 properties and performance of the resulting structure 
as well as increased costs. 

Various variables can affect powder aiming 
or deposit to the molten puddle, including nozzle or 
laser standoff from the workpiece and feed parameters 

10 for powder dispersed from the nozzle. During 
operation, the position of the laser or nozzle can 
shift or other parameters can vary as a result of the 
high operating temperatures. Variations in the 

operating parameters can affect aiming of the powder 

15 into the molten puddle. 

In prior applications,, the weld area is 
visually inspected to assure accurate deposit of the 
powder in the molten puddle. However, such visual 
inspection is not systematically controlled. Prior 

20 systems which provide size and dimension control of 
the puddle based upon a puddle image do not provide a 
complete control solution for accurately aiming 
powder in the molten puddle. The present invention 
addresses these and other problems and provides 

25 solutions not recognized nor taught by the prior art. 
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SUMMARY OF THE INVENTION 
The present invention relates to an imaging 
system for controlling powder aiming into a molten 
5 puddle. In the imaging system of the present 

invention, an image processor extracts a first image 
of the molten puddle and a second imag.e of a powder 
envelope from a captured image of the weld area. The 
first and second processed images provide feedback 
10. for process control. 



BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a schematic illustration of an 
embodiment of a deposition welding operation. 
15 FIG. 2 is an illustration of a weld area 

including a molten puddle. 

FIG. 3 is an illustration of a tip portion 
of an embodiment of a powder feed nozzle having gas 
assisted dispersement . 
20 FIG. 4 is a schematic illustration of a 

deposition welding operation including image feedback 
for powder aiming. 

FIG. 5 is a schematic, illustration of a 
digital image of a weld area including a molten 
25 puddle. 

FIG. 6 is a flow chart illustrating an 
embodiment of image processing operations for a 
reflected image of the weld area. 
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FIG. 7 is a schematic diagram illustrating 
an embodiment of feedback control for powder aiming 
based upon a reflected image. 

FIGS. 9-10 illustrate alternate embodiments 
5 of operating controls for a laser and a feed nozzle 
of a deposition welding system. 

FIG. 10 is a schematic illustration of an 
embodiment of a standoff or position feedback control 
system for a laser using a reflected image of .the 
10 laser beam. 

FIG. 11 is a schematic illustration for 
using a reflected laser image for standoff control. 

FIG. 12 is a flow chart illustrating an 
embodiment for image processing operations for 
15 alignment or standoff control. 

FIG. 13 is a schematic illustration for 
using a reflected laser image for orientation or 
alignment control . 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
20 FIG. 1 schematically illustrates an 

embodiment of a welding apparatus 50 for deposition 
welding. As illustrated a flowable welding material. 
52, such as a titanium powder or other metal powder 
or material mixture is dispersed from a nozzle 54 to 
25 a molten puddle 56. The molten puddle 56 is heated 
from an energy power source or laser 58 to melt the 
weld powder 52. Powder is fed to nozzle 54 from a 
powder or weld material source 59. Multiple layers 
of powder are deposited to a workpiece 6 0 to 
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fabricate components of various shapes and sizes via 
direct metal deposition. 

As shown in FIG. 1, table 62 movably 
supports the workpiece 60 as illustrated by arrow 64. 
5 The table 62 is moved to deposit material or powder 
in a predetermined pattern to form complex three- 
dimensional objects or parts. Alternatively, the 
laser 58 and nozzle 54 can move relative to the table 
62 and workpiece 60 to deposit powder in a 

10 predetermined pattern as described. 

For deposition welding, after each layer is 
formed, the nozzle 54 and laser .58 are indexed or 
raised a distance corresponding to the thickness of 
the deposited layer to maintain the elevation or 

15 standoff distance of the laser 58 and nozzle 54 from 
the workpiece. As shown schematically, the nozzle 54 
and laser 58 are operated by actuator 66 to provide 
desired standoff of the laser 58 and nozzle 54 and 
movement of the table 62 based upon control or 

20 operating commands generated by controller 68. 

Laser beam 70 from laser 58 forms the 
molten puddle 56 on the workpiece 60. In one 
embodiment laser is a CO2 laser and the deposited 
powder is a titanium alloy powder. FIG. 2 is a • 

25 schematic illustration of a weld area 72 including 
molten puddle 56. Powder is dispersed from the 
nozzle 54 into the molten puddle 56 to form powder 
envelope 74. As previously explained, it is 

desirable to accurately aim the powder relative to 

30 the molten puddle 56 to optimize the metallurgical 
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properties of the deposition welded object. For 
example, it is desirable to aim powder into a hot 
spot 75 of the molten puddle 56. 

Various operating parameters affect 
5 placement of the powder in the molten puddle 56, 
including laser parameters, such as alignment and 
standoff, and nozzle operating parameters such as 
standoff and powder feed and dispersement parameters 
as will be described. FIG. 3 illustrates a tip 

10 portion 76 of an embodiment of a gas assist powder 
feed nozzle 54-1. The nozzle 54-1 includes a powder 
feed channel 80. Powder is fed through channel 80 
from source 59 via a gas assist- Nozzle also 
includes focus gas channels 82. Focus gas is 

15 delivered to channels 82 from source 84 to focus or 
control the profile of powder dispersed from the 
nozzle 54-1. Thus the profile dimensions and 

location of the powder envelope 74 is influenced by 
nozzle operating parameters including gas assist 

20 parameters, focus gas parameters as well as standoff 
of the nozzle tip 76 from the workpiece 60. 

During welding operation, operating 
parameters can shift or vary resulting in variations 
in powder deposit into the molten puddle 56. The 

25 weld area can be visually inspected to assure optimum 
placement of the deposited powder into the molten 
puddle 56, however, visual inspection does not 
provide systematic and automated control. The system 
of the present invention provides automated feedback 

30 of the weld area to control the aim of powder into 
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the molten puddle 56 for enhanced control of the 
welding process, 

FIG. 4 illustrates an embodiment of a 
system of the present invention where like numbers 
5 are used to identify like parts in previous FIGS. As 
shown, an imager 90, such as a digital camera or 
charged coupled device (CCD) camera is supported to 
capture a digital image reflected from the weld area 
72 . The composite image of the weld area 72 is 

10 processed by an image processor 94 illustrated 
diagrammatically to isolate or extract a reflected 
image of the molten puddle from a reflected 
background or the workpiece and to extract a 
reflected image of the deposited powder envelope 74 

15 as will be explained, 

A reflected digital image 96 of the weld 
area 72 is schematically shown in FIG. 5. The 
reflected digital image 96 comprises an array of grey 
tones or intensities corresponding to the reflection 

20 of the imaged weld area 72. The composite reflection 
of the weld area includes an image of the molten 
puddle 98, background 100 and powder envelope 102 
which have different grey tones or intensities as 
illustrated schematically in FIG. 5. The processor 

25 distinguishes the reflected digital images of the 
weld puddle 98, background 100 and powder envelope 
102 from the composite image based upon different 
grey tones or intensities of the reflected image of 
the weld area. 
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As shown in FIG. 6, image processor 94 
includes a first image processor configured to 
extract or isolate a first image 108 as illustrated 
by block 110 of the molten puddle 98 having a grey 
5 tone distinguishable from background 100 and powder 
envelope 102. The image processor 94 includes a 
second image processor configured to extract or 
isolate a second image 112 of the deposited powder or 
envelope 102 from the molten puddle 98 or background 

10 100 as illustrated by block 114. 

The first and second image processors 
extract the first and second images 108, 112 by 
filtering the digital image of the weld area 96 to 
isolate the low intensity background 100 from the hot 

15 puddle 98 to extract a processed image of the molten 
puddle and to extract the reflected powder envelope 
102 from the molten puddle 98 to extract a processed 
image of the powder envelope 102 . The digital image 
96 can be optically or digitally filtered. The first 

20 and second processed images are used to analyze 
powder aiming into the molten puddle. . 

The processed images of the molten puddle 
and powder envelope are used to calculate or 
determine profile parameters of the molten puddle and 

2 5 powder envelope, such as area dimensions and boundary 
dimensions or coordinates of the molten puddle and 
powder envelope, as illustrated by blocks 116, 118 in 
FIG. 6. In the embodiment shown, the area and 
boundary coordinates of the molten puddle and powder 

30 envelope are measured as shown by illustrations 120, 
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122. The measured data is used to calculate the 
position or location of the powder envelope in. the 
molten puddle. In the embodiment shown a bias is 
calculated as illustrated by block 124 for the imaged 
5 position of the powder envelope relative to a 
reference or predetermined position of the powder 
envelope. For example, powder aiming may be desired 
in the hot spot 75 or in the center portion of the 
molten puddle. Thus, the calculated bias measures 

10 the difference between the imaged powder position and 
the reference or centered powder position. 

As previously described various operating 
parameters affect powder aiming. FIG. 7 illustrates 
feedback control based upon output or a bias 124 from 

is the image processor 94. The image feedback or bias 
from the image processor 94 is provided to a control 
processor 128 to calculate an offset command 129 to 
adjust operating parameters of the actuator 66 
operating the laser 58, nozzle 54, and table based 

20 upon . processed feedback of the molten -puddle and 
powder envelope. Thus the bias calculation is used to 
calculate the offset command 129 used by the 
controller 68 to control system actuators 66 
illustrated schematically to deposit powder into the 

25 molten puddle as illustrated by block 130. 

As schematically shown in FIGS. 8-9, the 
system actuator 66 can include standoff actuator 132 
for the laser and .nozzle and a powder feed actuator 
134 for nozzle. Alternatively, system actuator 66 

3 0 can include standoff actuator for the laser 136, 
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standoff actuator for the nozzle 138 and powder feed 
actuator 134 for the nozzle. Application of the 
image processing for powder aiming of the present 
invention is not limited to the specific embodiments 
5 shown . 

As previously described, during operation 
alignment of the welding components can shift which 
can affect powder aiming and control of powder 
deposit to the molten puddle. Correct alignment is" 

10 necessary for powder aiming.. FIGS, 10-13 

schematically illustrate a system for measuring 
standoff or alignment of the laser using a reflected 
image of* the laser itself. Standoff is the distance 
of the laser from the workpiece 60. As shown in FIG. 

15 1, laser 58 projects laser beam 70 which is reflected 
off a workpiece surface 60. Imager 90 or CCD camera 
is orientated toward the workpiece surface 60 to 
capture the reflected image of the weld area and 
laser beam 70. As shown, the reflections (140-1, 

20 140-2 from the laser beam of the workpiece shift 
based upon the standoff elevation of the laser 58-1, 
58-2. The position shift of the laser beam 

reflection 140-1, 140-2 is used to measure the 
alignment or standoff . of the laser from the workpiece 

25 surface 60. 

As shown in FIG. 11, imager 90 captures a 
two dimensional digital image 146 of a reflection of 
the weld area. As shown, the reflected image of the 
laser 58 produces a bright spot 148 which can be 

3 0 isolated or extracted from the digital image based 
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upon the intensity of the bright spot 148 relative to 
the background. The position of the bright spot 148 
in the two dimensional digital image 14 6 is used to 
measure the standoff of the laser relative to the 
5 workpiece 60. As shown, the position of the bright 
spots 148-1, 148-2 shifts along axis 150 of the 
reflected image 14 6 based upon changes in the 
standoff distance of the laser 58 from the workpiece. 
For example as shown, in FIG. 11, the reflected 

10 bright spot 148-1 for laser having an elevation or 
standoff distance Zi is spaced along axis 150 from 
bright spot 148-2 having a standoff distance Z2 . Thus 
the Az (standoff difference .22-Zi) is proportional to 
the distance between reflections 148-1 and 14 8-2 on 

15 digital image 146. 

Thus as ' illustrated in FIG. 12, the digital 
image 146 is processed or filtered by processor 151 
as illustrated by block 152 to extract the reflected 
bright spot 148 of the laser beam. As previously 

20 explained, the image can be optically or digitally 
filtered to extract the bright spot 148. The 
position of the bright spot is scaled as illustrated, 
by block 154 relative to a reference standoff 
distance to provide a bias calculation which is used 

25 to calculate an offset command as illustrated by 
block 156. The calculated offset command is 

transmitted to positioner or actuator 158 illustrated 
diagrammatically in FIG. 10 to adjust the standoff 
position of the laser for desired operating control. 

30 Thus, the laser's own reflection can be used for 
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accurate standoff control of the laser to control 
operating parameters for optimum powder aiming. 

The orientation or alignment of the laser 
relative to the workpiece can also be controlled by 
5 the reflected image of -the laser as shown in FIG. 13. 
As shown, the alignment of the laser is controlled 
relative to a reference datum 160 to control the 
position of the molten puddle. Shift or changes in 
the orientation of the laser reflection 140 relative 

10 to the reference datum 160 are measured from a 
reflected digital image 146 of the weld area. As 
shown in FIG. 13 the digital image 14 6 includes 
scattered intensity points 162 due to the dynamic 
operating environment of the laser welding process. 

15 The image is processed to filter intensity points 162 
outside set boundary parameters and the remaining 
points 162 are processed or averaged to control the 
alignment of the nozzle 58 relative to a defined 
reference datum. 

20 Image 146 is filtered through a low pass 

filter to smooth the scattered image points 162 and 
filtered the image to remove extraneous intensity 
points 162 with a large sigma or deviation from 
normalized points 164. The position of the 

25 normalized points 164 is calculated or averaged and 
scaled relative to the reference datum 160 to provide 
a bias calculation which is used to derive an offset 
command to adjust alignment of the laser. Thus, as 
described, a calculated offset command is executed by 

30 a laser actuator or positioner having x-y-z control 
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to adjust alignment and standoff of the laser 
relative to a reference position or datum for 
operating control . 

Although the present invention has been 
5 described with reference to preferred embodiments, 
workers skilled in the art will recognize that 
changes may be made in form and detail without 
departing from the spirit and scope of the invention 
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WHAT IS CLAIMED IS: 

1. In combination: 

an energy source orientated to form a 
molten puddle on a workpiece; 

a nozzle coupleable to a source of flowable 
weld material and having a discharge 
opening orientated to deposit the 
flowable weld material to the molten 
puddle; 

an imager orientated to capture a feedback 
image of a weld area including the 
molten puddle and flowable weld 
material deposited therein; and 

an image processor coupled tc the imager 
including.: 

a first image processor to extract a 
first image of the weld puddle; and 
a second image processor to extract a 
second image of the deposited weld 
material. 

2. The combination of claim 1 wherein the first 
image processor calculates boundary coordinates of 
the first image of the weld puddle. 

3. The combination of claim 2 wherein the 
second image processor calculates boundary 
coordinates of the second image of the deposited weld 
material 
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The combination of claim 3 wherein the 
image processor calculates a bias based upon a 
reference profile of the weld material in the molten 
puddle and a calculated profile based upon boundary 
coordinates of the first and second images. 

5- The combination of claim 4 and further 

comprising a control processor configured to 
calculate a control command based upon the calculated 
bias between the reference profile and calculated 
profile to adjust operating parameters. 

6. The combination of claim 5 wherein the 
control command adjusts standoff control parameters. 

7. The combination of claim 5 wherein the 
control command adjusts powder feed or dispersement 
parameters • 

8- The combination of claim 1 wherein the 

energy source is a laser. 

9. In combination: • 

a laser orientated to form a molten puddle 

on a workpiece; 
an imager orientated to capture an image of 

a laser beam projected from the laser 

and reflected from the workpiece; and 
a processor coupled to the imager and 

configured to process the reflected 
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image of the laser beam to measure the 
position of the laser relative to the 
workpiece. 

10. The combination of claim 9 wherein the 
processed reflected image of the laser beam is used 
for standoff control. 

11. The combination of claim 9 wherein the 
processor extracts the reflected image of the laser 
beam from a background image. 

12. The combination of claim 9 wherein the 
processor calculates a bias based upon a reference 
position of the laser beam reflection and a measured 
position of the. laser beam reflection for standoff 
control . 

13 . The combination of claim 12 wherein an 

offset command is calculated based upon the 
calculated bias to adjust standoff. 

14. The combination of claim 9 wherein the 
processed reflected image of the laser beam is used 
for alignment control of the laser. 

15. The combination of claim 9 wherein the 
processor calculates a bias based upon a reference 
position of the laser beam reflection and a measured 
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position of the laser beam reflection for alignment 
control . 

16- The combination of claim 15 wherein an 

offset command is calculated based upon the 
calculated bias to adjust alignment of the laser. 



17, A method for welding control comprising 
steps of: 

heating a workpiece to form a . molten 
puddle ; 

depositing a weld material to the molten 

puddle in a welding area; 
imaging the welding area; and 

processing a composite image of the welding 
area to extract an image of the molten 
puddle and an image of the weld 
material deposited into the molten 
puddle . 

18. The method of claim 17 wherein the step of 
processing the image of the welding area further 
comprising the steps of : 

determining boundary coordinates of the 
extracted images of the molten puddle 
and weld material to calculate a 
measured, profile of the weld material 
in the molten puddle; and 
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calculating a bias of the measured profile 
relative to a reference profile of the 
weld material in the molten puddle. 

19. The method of claim. 18 and further 
comprising a step of: 

adjusting operating parameters to adjust 
the profile of the deposited weld 
material in the molten puddle relative 
to the reference profile based upon 
the calculated bias. 

20. The method of claim 15 wherein the step of 
adjusting the operating parameters includes adjusting 
at least one of laser position, . nozzle position or 
powder feed parameters . 
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